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Abstract 



We give a sufficient condition for the exponential decay of the tail probability of a non- 
negative random variable. We consider the Laplace-Stieltjes transform of the probability dis- 
tribution function of the random variable. We present a theorem, according to which if the 
abscissa of convergence of the LS transform is negative finite and the real point on the axis 
of convergence is a pole of the LS transform, then the tail probability decays exponentially. 
For the proof of the theorem, we extend and apply so-called a finite form of Ikehara's complex 
Tauberian theorem by Graham- Vaaler. 

Keywords: Tail probability of random variable; Exponential decay; Laplace transform; Com- 
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1 Introduction 

The purpose of this paper is to give a sufficient condition for the exponential decay of the tail 
probability of a non-negative random variable. For a non-negative random variable X, P{X > x) 
is called the tail probability of X. The tail probability decays exponentially if the limit 

lim - log P(X > x) (1) 

X^QO X 

exists and is a negative finite value. 

For the random variable X, the probability distribution function of X is denoted by F{x) = 
P{X < x) and the Laplace-Stieltjes transform of F{x) is denoted by ip{s) = e~^^dF{x). We 
will give a sufficient condition for the exponential decay of the tail probability P{X > x) based on 
analytic properties of ip{s). 

In [IT], we obtained a result that the exponential decay of the tail probability P{X > x) is 
determined by the singularities of f{s) on its axis of convergence. In this paper, we investigate 
the case where 99(5) has a pole at the real point of the axis of convergence, and reveal the relation 
between analytic properties of (p{s) and the exponential decay of P{X > x). 

The results obtained in this paper will be applied to queueing analysis. In general, there are 
two main performance measures of queueing analysis, one is the number of customers Q in the 



system and the other is the sojourn time W in the system. Q is a discrete random variable and 
is a continuous one. It is important to evaluate the tail probabilities P{Q > q) and P{W > w) 
for designing the buffer size or link capacity in communication networks. Even in the case that the 
probability distribution functions P{Q < q) or P{W < w) cannot be calculated explicitly, their 
generating functions Q{z) = Yl'^o^iQ ~ ^)^'^ °^ W{s) = e~^'^dP{W < w) can be obtained 
explicitly in many queues. Particularly, in M/G/1 queue, Q{z) and W{s) are given explicitly by 
Pollaczek-Khinchin formula [7j. So, in this paper, we assume that we have the explicit form of a 
generating function and then investigate the exponential decay of the tail probability based on the 
analytic properties of the generating function. 

Such kind of researches have been studied motivated by a requirement for evaluating a packet 
loss probability of a light tailed traffic in the packet switched network. 

An approach by the complex analysis is seen in [3]. A sufficient condition is given in [3] for the 
decay of the stationary probability of an M/G/1 type Markov chain with boundary modification 
and the result is applied to MAP/G/1 queue. Let vr = (7r„) denote the stationary probability of 
an M/G/1 type Markov chain with boundary modification, and tt{z) = ^^tt^z" the probability 
generating function of vr with the radius of convergence r > 0. In [3], they proved a theorem that 
if z = r is a pole of order 1 and is the only singularity on the circle of convergence \z\ = r, then 
there exists K > 0, f > r such that vr^ = Kr~"' + 0{f~^). Our Theorem 1 below is an extension 
of this theorem in [3j . 

In p], for the stationary queue length Q of a queueing system which satisfies some large devia- 
tions conditions, it is shown that the P{Q > n) decays as P{Q > n) ~ ■(/'6xp(— 0n) with a positive 
constants ip and 9. In [^4], it is shown that the stationary waiting time W and queue length Q 
decay exponentially for a broad class of queues with stationary input and service. In |13|.|14j. the 
stationary distribution of M/G/1 or G/M/1 type Markov chains are deeply studied. In [16], the 
tail of the waiting time in PH/PH/c queue is investigated. In [9], a sufficient condition is given for 
the stationary probability of a Markov chain of GI/G/1 type to be light tailed. 

This paper is organized as follows. In section II, an application of our results to queueing analysis 
is presented. In section III, an example of a random variable is given whose tail probability does 
not decay exponentially. In section IV, some Tauberian theorems are introduced and the relation 
to our problems is stated. In section V, some lemmas are given and our main theorem is proved in 
the case of a pole of order 2. In section VI, the statement of lemmas and theorems are presented 
for a pole of arbitrary order. Finally, we summarize out results in section VII. 

Throughout this paper, we use the following symbols. C, M, Z, 3ft denote the set of complex 
numbers, real numbers, integers, and the real part of a complex number, respectively. 

2 Application to Queueing Analysis 

The author already had results on the exponential decay of the tail probability for a discrete random 
variable [TO], and those for a general random variable [llj. The main theorem in [10] is as follows. 

Theorem 1 [lOj Let X he a random variable taking non-negative integral values, and f{z) be 
the probability generating function of X . The radius of convergence of f{z) is denoted by r and 



1 < r < oo is assumed. If the singularities of f{z) on the circle of convergence \z\ = r are only a 
finite number of poles, then 

lim — log P(X > n) = — log r. (2) 

n^oo n 

We can apply Theorem [1] to queueing analysis as follows. 

Consider, for example, the number of customers Q in the steady state of M/D/1 queue with 
traffic intensity p. The probability generating function Q{z) = Yl'^=oPiQ — Q)^'^ Q is given by 
Pollaczek-Khinchin formula [7]: 

Q{z) = i^-P)i--^)^Mp{z- 1))^ 
z - exp{p{z - 1)) 

The radius of convergence of Q{z) is equal to the unique solution z = r > 1 of the equation 
z — exp(/)(z — 1)) = 0. Since Q{z) is meromorphic in the whole finite complex plane \z\ < oo, in 
particular, the singularities of Q{z) on the circle of convergence \z\ = r are only a finite number of 
poles. Therefore, by Theorem [H we know that the tail probability P{Q > q) decays exponentially 
as (7 — > oo. 

Next, in [11], the exponential decay of the tail probability P{X > x) is investigated for a general 
non-negative real valued random variable X. The main theorem in [11] is as follows. 

Theorem 2 [llj Let X be a non-negative random variable, and f{s) be the Laplace-Stieltjes trans- 
form of the probability distribution function of X. The abscissa of convergence of ip{s) is denoted 
by (To and —oo < ctq < is assumed. If the singularities of (p{s) on the axis of convergence ^s = (Tq 
are only a finite number of poles, then we have 

lim -logP(X > x) = o-Q. (4) 

Let us apply Theorem [2] to queueing analysis. In this case, however, the situation is somewhat 
different from that in the case of discrete random variable. 

Consider the sojourn time W in M/D/1 queue with traffic intensity p. Writing W{s) as the 
Laplace-Stieltjes transform of the probability distribution function P{W < w) of W, we have [7] 

Wis) = i^-P>-M-s) 

s - p + pexp{-s) ^ ' 

The abscissa of convergence of VK(s) is the unique negative solution s = (Jq of the equation s — p-\- 
/9exp(— s) = 0. We can see that the singularity of on the axis of convergence = (Tq is only 

a simple pole s = [12j. In fact, the location of the poles of are shown in Figure 1. The 

abscissa of convergence is do = —1.26 for p = 0.5. Though, it is not easy to prove that s = (Tq is the 
only singularity of W{s) on the axis of convergence. In order to prove it, we need some theorems 
such as Rouche's theorem. 

The statement of Theorem [1] and [2] are formally quite the same, but to verify that the assumption 
in Theorem [2] holds is more difficult than Theorem [TJ This is because of the difference of the 
convergence regions. In Theorem (H the boundary of the convergence region of a power series is a 



100r 

80 
60 
40 
20 
T 0- 
-20 
-40 
-60 
-80 
-100 



-5 -4 -3 -2 -1 

a 



Figure 1: The poles of W{s) in ([5]) with p = 0.5, s = a + ir 



circle, which is a compact set, so if the probability generating function is meromorphic, then the 
singularities on the circle of convergence are necessarily a finite number of poles. On the other 
hand, in Theorem [21 the axis of convergence is not a compact set, so we need some verification to 
see that the singularities on the axis of convergence are a finite number of poles. We want some 
simple sufficient condition to guarantee the exponential decay of the tail probability. We see, in 
fact, that the conclusion of Theorem[2]is really stronger than desired, so it may be possible to relax 
the assumption that the number of poles on the axis of convergence is finite. 
We have the following theorem. This is the main theorem in this paper. 

Theorem 3 Let X be a non-negative random variable, and F{x) = P{X < x) be the probability 
distribution function of X . Let 

l-OO 

ip{s)= e-'^'dFix), s = a + iT eC (6) 
Jo 

be the Laplace- Stieltjes transform of F{x) and be the abscissa of convergence ofip{s). We assume 
— oo < do < 0. If s = ao is a pole of (p{s), then we have 

lim -logP(X > x) = o-Q. (7) 

X^QO X 



Remark 1 Since F{x) is non- decreasing, s = is a singularity of f{s) by Widder [17J, p. 58, 
Theorem 5b. We assume in Theorem^ that this singularity is a pole. 



3 Example of Random Variable whose Tail Probability does not 
Decay Exponentially 



We show an example of a non-negative random variable whose tail probability does not decay 
exponentially, i.e., x^^ log P{X > x) does not have a limit [llj. 
For any positive integer h, define a sequence {cn}^=Q by 



Co = 0, 

Cn = Cn-l + h''"~\ n = l,2, ... 



We define a function 7(x) by 

7(x) = h'"", for Cn <x < Cn+i, n = 0, 1, • • • . (9) 

For arbitrary (Tq < 0, put F*{x) = 1 — e'^'^^^{x), x > 0. We see that F*{x) is right continuous 
and non-decreasing with F*{0) = 0, F*(oo) = 1, hence F*{x) is a distribution function. Let us 
define X* as a random variable with probability distribution function F*(x). We write ^*{s) as 
the Laplace-Stieltjes transform of F*{x). The following theorem shows that X* is an example of a 
random variable whose tail probability does not decay exponentially. 

Theorem 4 (see[llj) Let X* , F*{x) andip*{s) be defined as above. Then, the abscissa of conver- 
gence of ip*{s) is (To, and we have 

lim inf — log P{X* > x) < ao — log h 

x— »oo x 

< CTq 

= lim sup — log P{X* > x) . 

x— >oo X 

All the points on the axis of convergence = gq are singularities of ip[s). 



Remark 2 From Widder [TT], p. 44, Theorem 2.4e, limsup^^oo x~^ \ogP{X > x) = ctq holds under 
the condition (To < and no other condition is necessary. Meanwhile, Theorem^ implies that some 
additional condition is required for liminfa;^oo 2;"^ log P(X > x) = (Tq. In our Theorem \^ the 
additional condition is the analytic property of ip{s). The example X* in Theorem^ is in a sense 
pathological, so we can expect that the exponential decay is guaranteed by some weak condition. 

4 Tauberian Theorems of Laplace Transform 

Theorem [3] deals with an issue of how the analytic properties of the Laplace-Stieltjes transform 
99(5) determines the asymptotic behavior of the tail probability P[X > x). (p{s) converges in the 
region 5?s > (Tq and defines an analytic function in this region. Thus, according to Widder [17j . 
p. 40, Theorem 2.2b, we see that P(X > x) = o^e'^^) as x — > 00 for < a < 0. The main problem 
is whether P{X > x) decays as P{X > x) = 0(e'^°^) as x — > 00. So, it is appropriate to apply 
Tauberian theorems of Laplace transform to this problem. 



In general, the relation between a function / and its transform Tf (such as power series, 
Laplace transform, etc.) is investigated by Abelian theorems or Tauberian theorems. In Abelian 
theorems, the asymptotic behavior of Tf is studied from the asymptotic behavior of /. Conversely, 
in Tauberian theorems, the asymptotic behavior of / is studied from that of Tf. In Tauberian 
theorems, generally, some additional condition is required for /. Such an additional condition is 
called a Tauberian condition. See [8j for the survey of the history and recent developments of 
Tauberian theory. 

The following is a well-known Tauberian theorem. 

Tauberian Theorem ( Widder |17j, p. 187, Theorem 3b) For a normalized function fi{x) of bounded 
variation in [0, L] for every L > 0, let the integral 

/•oo 

ip{s) = / e~'"'diJ.{x) 
Jo 

exist for s > and let lims^o+ = A. Then 

lim fi{x) = A 

x—*oo 

holds if and only if 

X 

tdfj,{t) = o(x), x ^ oo. (10) 

In the above theorem, Tauberian condition is (jlOp . So, in this theorem, to study the asymptotic 
property of a function /u, other asymptotic property is assumed. I think that this type of Tauberian 
theorem is not easy to apply to some practical problems. 

Ikehara first succeeded [U] in removing such asymptotic conditions from Tauberian theorem, 
instead, he posed some analytic properties of (p{s) on the boundary of convergence region. 

4.1 Ikehara's Tauberian Theorem 

The following is Ikehara's Tauberian theorem, in which an analytic property of Laplace-Stieltjes 
transform is assumed. The Tauberian condition is the non-decreasing property of the function S{t). 

Theorem (Ikehara |6j, see also [8j) Let S{t) vanish for t < 0, be non- decreasing, right continuous, 
and the integral 

ip{s)= e-'^dS{t), s = a + iT (11) 
Jo 

exist for a > 1. There exists a constant A such that the analytic function 

Ms) = ^{s) - ^s > 1 (12) 

s — 1 

converges as a I I to the boundary function ipo{l + ir) uniformly {or in L^) for —X < r < A with 
any A > 0. Then we have 



lim e-*5(i) = A. 

t—i-ao 



(13) 



4.2 Finite Form of Ikehara's Theorem by Graham- Vaaler 

In Ikehara's theorem, since A > is arbitrary, i^is) is assumed to be analytic on the whole axis 
of convergence = ctq except the pole s = (Tq. As mentioned previously, because the axis of 
convergence is not compact, it is difficult to check whether (p{s) satisfies the theorem assumption 
or not. The following extension by Graham- Vaaler [5] solves this difficulty by relaxing the limit 
(|13p of e~^S{t). This theorem is called a finite form of Ikehara's theorem because A is restricted to 
some range of values. 

We make preliminary definitions in order to state Graham-Vaaler's theorem. 

For to > 0, define a function E^{t) by 

For A > 0, a real function f{x) is of type A if f{x) is the restriction to M of an entire function f{z) 
of exponential type A. An entire function f{z) is of exponential type A [15j if it satisfies 

\f(z)\ < C7exp(A|z|), z G C, C > 0, A > 0. (15) 

A function f{x) is a majorant for a function g(x) if f{x) > g{x) for any x G M, and f{x) is a 
minorant for g{x) if f{x) < g{x) for any x G M. 

Theorem (Graham-Vaaler [5], see also [8]) Let S{t) vanish for t < 0, be non- decreasing, right 
continuous, and the integral 

POO 

ip{s)= I e-'^dS{t), s = a + iT (16) 



exist for a > 1. There exists a constant A such that the analytic function 

ifois) = ifis) - > 1 (17) 

s — 1 

converges as a [ 1 to the boundary function (/?o(l + iT) uniformly [or in L^) for — A < r < A with 
some A > 0. Then, for any majorant M{t) for Ei{t) of type A and any minorant m(t) for Ei(t) of 
type X, we have 

/oo 
m(t)dt < liminf e"*S'(t) (18) 
-oo 

/oo 
M{t)dt. (19) 
-oo 

5 Main Theorem 

We write below our main theorem again. By this theorem, we do not need to check the location 
of singularities of the LS transform (p{s) and if (/'(•s) is meromorphic then the assumption of the 
theorem is necessarily satisfied. 

Theorem [3] Let X be a non-negative random variable, and F{x) = P[X < x) be the probability 
distribution function of X . Let 

POO 

ip{s) = / e-'^'dFix) (20) 



be the Laplace- Stieltjes transform of F{x) and gq he the abscissa of convergence ofip{s). We assume 
— oo < ctq < 0. If s = ctq is a pole of (p{s), then we have 

lim -logP(X > x) = do. (21) 

x^oo X 

It is possible to give a proof for arbitrary order of poles, but the description becomes very 
complicated, so we will prove only for the pole of order 2. A proof for higher order poles is easily 
obtained from the proof for the pole of order 2. 

5.1 Preliminary Lemmas for the Proof of Main Theorem 

For (J > 0, we define functions 

3 

R{v) = r^-^^, v£R, (22) 

R"(lo) 

R^{v) = R{v + w) - R{uj) - R'{uj)v ^ ^ ^- (23) 

By calculation, we have 

„ Qv 6v'^e~'" 2v^e~'^'" v^e^^ 

^ = ~ (l-e-)2 + (l-e-)3 + (l-e-)2' ^'^^> 

_ 6 18ue-^ 18^^6-2^ g^^e-^ Qv^e-^'' Qv^e'^'" 

- i_e-^ " (1 -e-^)2 ^ (1 -e-^)3 ^ (1 - e-^)2 " (1 - e-^)^ ~ (1 - e-^)3 



^3g D 

" (l-e-^)2' 

, -24e-^ 72ve-2^ SGue"'' 72t;2e-3'' 727;2e-2'' 12t>2e-^ 



(26) 



(l_e-^)2^(l-e-^)3 (l-e-^)2 (1 - e-^)^ (1 - e-^)3 (1 - e-^)2 
24y3g-4t; 36i;3e-3t' 14t;3e-2^ 



^ (1 - e-^f ^ (1 - e-^)4 + (1 - e-^Y ^ (1 - e-^)2 ' 
We have the following lemmas. 

Lemma 1 There exists cjq > sitc/i i/iai /or any to >IjOq, 

r i?^(w) > 0, ^; > 0, 

{ ~ (28) 

Proof: From (j26p . we have R"'{v) ~ 6 for sufficiently large u > 0, or more precisely, for any e > 
there exists u o > such that \R"'{v) — 6j < e holds for v '>vq. Hence, by taking e sufficiently small, 
we have R"'{v) > 5 > for v > vo, especially, R"{v) is monotonic increasing for v > v^. Further, 
from (1251) we have 



lim R"{v) = oo, (29) 
lim R"{v) = 0. (30) 



R" 



Write C = maxt,<„(, R"{v), which is finite by pOj) . From ([22D, there exists loq with R"{ujq) = C + 1 
and i^{)'>vq. Then, we have 

maxi?"(t>) = max I maxi?"(t'), max R"{v)\ (31) 

V<.LOq \v<.Vq V()<V<U!o J 

= max(C7, C + 1) (32) 

= C + 1 (33) 

= i?"(wo). (34) 
Since R"{v) is monotonic increasing for v > ujo{> vq), we have 

maxR"{v) = R"{oj), Vuj > loq- (35) 

V<iL> 

Next, for u > ljq, we have 

maxi?"(w) = R"{uj), Muj > ujq (36) 

i;>tij 

because R"{v) is monotonic increasing for v > w(> c<Jo > vq). From (j23p . we have R'^{v) = 
R"{v + 1^) — R"{uj), thus for w > we have from ([35]) . ([36]) . 

From i?^(0) = 0, we have R'^{v) > 0, € M. So, Ru{v) is monotonic increasing in t>. Then, 
^^(0) = imphes (|28l) . 



Lemma 2 For sufficiently large u > 0, 



1 - e-'' ' 



Proof: (j38p is easily obtained from (j24p . We have from ([26 



thus, (1391) holds. 



^"'(^) = - (1 + ^(^^')) ' ^ ^ (40) 



Lemma 3 There exists uq > smc/i that for any lo >ijOq, 

RUv) < r^^^'', > 0. (41) 

1 — e 

Proof: By the mean value theorem and Lemma [21 there exists vq with uj < vq < v + uj such that 

RUv) _ R"'{vo) 
3! 

< \ ■ ^ (42) 
3! l-e-'^o ^ ^ 

< i . (43) 



Lemma 4 There exists ujq > such that for any uj > uq, 

R^{v)e*''dv < t > 0. 

-OO 



Proof: By calculation, for uj > 



R{uj) , R'{lo) R"{uj) 

12 P~' 



/ R^{v)e*''dv= f R{v + uj)e''"dv-^^ + 

J — OO J — OO ^ 

and from integration by parts 

J —OO II I It J —OO 

where R^^\v) denotes the fourth derivative of R{v). Hence from (j45p . ()46p . we have 

fO 1 />0 



+ / RUv)e'''dv = \ [ R^^\v + uj)e'''dv 

J —OO J —OO 

R^^\v)e'''dv. 



' — OO 



t^ 

Then, we will prove that there exists loq > such that for any cj > cjq 

R^^\v)e^''dv > 0, t>0. 



We divide into two cases t > 1 and < i < 1. 

First, let us consider the case t > 1. From (1271). we have 



0{v^e"), V -OO, 



especially, R^'^^ (v) is bounded in M. From ([l8j) we see that there exist constants C > 0, u o > 



-C, < vq. 



Thus, for t > 1, 



R^^\v)e''"dv >-C e'^dv + - / v 

'OO J —OO ^ J Vq 



^e^'-'>dv 



„,3 „aj(t-l) _ pi>o(i-l) 

> _C7e*''» + 

2 t- 1 



For any e > 0, putting luq = vq + e^°/e, we have for any to > loq, 

>e^o(*-^)|l + ^(t-l)|, t>l, 



or 

{t - 1)6"°* 



< e, t>l. (55) 



gCol(t-l) _ gVo(t-l) 

Therefore, we have from (j52p . ()55p . by taking e sufficiently small, for uj > loq, 

R^^\v)e^''dv > 0, t > 1. (56) 

Next, we consider < t < 1. We first restrict < t < 1. The cases t = and t = 1 will be 
considered later. We calculate 



R^^\v)e^'"dv, 0<t<l. (57) 

J —oo 

Here, we put t = —s and 

/oo 
R^^\v)e-'''dv, -1< s < 0. (58) 
-oo 



(j){s) is the bilateral Laplace transform [T7] of R^'^\v). The region of convergence is —1 < < 1. 
We apply the following theorem. 

Theorem A (Widder |17j . ^.239, Theorem 3d) Let a{v) be of bounded variation on any finite 
interval. If the integral 



f{s) = / e-'^daiv) (59) 

J — oo 

exists for s = sq, JRsq < 0, and a(oo) = 0, then 

/oo 
e-''>^a{v)dv. (60) 
-oo 

(end of theorem citation) 

Let us define a step function A(w) as 

AW = I n ' - n (61) 
and define ai{v) = R"'{v) - 6A(?;). Then, 

/OO poo 
e~'''dai{v)= / e" R^^\v)dv -Q<oo, (62) 
-oo J —oo 

and ai(oo) = 0, so ai{v) satisfies the assumptions of the above Theorem A. Hence, we have from 
Theorem A and (j62p 

CO ;>oo 

e-''"R^^\v)dv-& = s e-'''ai{v)dv. (63) 



oo J — oo 



Next, define a2{v) = R"{v) - Qv/^{v), then from (HID, ([MD 

j'OO 

e-''"da2{v) = / e-'''ai{v)dv < oo, (64) 



and 02(00) = 0, so 02 (f) satisfies the assumptions of Tlieorem A. Hence, we liave from Theorem 
A and §^ 

/oo roo 
e-'''aiiv)dv = s / e-'''a2iv)dv. (65) 
-00 J —00 

In a similar way, by defining as{v) = R'{v) — 3v'^A{v), a4^{v) = R{v) — v^A{v), we have from 
Theorem A 

/oo poo 
e-'''a2{v)dv = s / e''" a:i{v)dv, (66) 
-00 J —00 

POO 

e-'''a^{v)dv = s / e-'''ai{v)dv. (67) 



Therefore, from (EHD, (ESI), (ESI), (EZD we have 



e-'"" R^^\v)dv - 6 = sM e-'''aA{v)di 
-00 J —00 



= s^{l — dv+ I — dv\,-l<s<Q. 

By the change of variables t = —s, 

/oo r /"O a,3ptv poo 3 tv ~\ 



e--l Jo e--l 
> 6, < t < 1. (70) 

Next consider t = 0. Define a function g{v) as 

f |i?(4)(?;)|e^/2, t;>0. 

Then from (jUI), ^(v) is integrable and \R^^\v)\e^'' < g{v), -t; G M, for < t < 1/2. By the 
dominating convergence theorem 

/oo 
R^^\v)e^''dv 
-00 

/ /-O ySgto /-oo ^3gto 

= 6 + limt • lim / dv + / dv 

t^o i^o+ Vy^oo 1 - e-^ 7o 

= 6 + limt^- / dv+ / dv 

= 6. (72) 
Last, for t = 1, we have from (|15|) 

/>oo 

i2(^)(i;)e''d?; = 00. (73) 
Summarizing ([70|) . ([72]) . ([75]) . we obtain 

/oo 
i?(^)(t;)e*^(iv > 6, < t < 1. (74) 
-00 



Now we show that there exists ujq > such that for any uj > uq, 

[ R'^^\v)e^''dv>5, 0<t<l. (75) 

J — oo 

Define 

/UJ 
R'-^\v)e^''dv, 0<t<l, uj>0. (76) 

For a fixed uj > 0, the integral in (|76p converges for t > —1. In fact, from (|27p . for any 6 > 0, 

R^^\v) <e(i-'^)^ (77) 

holds for any v < with sufficiently large absolute value. By the change of variables v = lo — u in 
the integral in (f76]l . we have 

/•oo 

(l)^{t)=e^^ R^^\to -u)e-^''du. (78) 



JO 

Hence from (j77p . the integral in (|78p converges for t > — 1. Then from Widder [17], p. 57, Theorem 
5a, we see that 4>u{t) is analytic for > — 1, especially (/>(^(t) is continuous for < t < 1. 

For a fixed t with < t < 1, from ()48p there exists > (which does not depend on t) such 
that for LO > LO* ^ (puj{t) is monotonic increasing in lo. 

From (j74p for any t with < t < 1, there exists Lo{t) > lo* such that 

4>uii){t)= / i?(^)(t;)e*^d^;>5. (79) 

J — oo 

By the continuity property of (t>u){t){'u) iii there is e = e(t,w(t)) > such that 

<i)^lt){u) > 5, n G (t - e, t + e) n [0, 1]. (80) 

Define Ut = (t — e, t+e)n[0, 1], then Ut is an open set in [0, 1] and t £ Ut, so IJo<t<i ~ I*-*' Since 
[0, 1] is compact, there exist ti, • • • , t„ G [0, 1] with Ut-^ U- • -UUt^ = [0, 1]. Let loq = maxi<fc<„ oj{tk), 
then for any oo > uoq, 

Mt)>^u.it,){t),teUt, (81) 

> 5 (82) 

holds for t E [0, 1]. From (j56p . (|82p we have completed the proof of Lemma [H 

Now, for LO > 0, define two functions M^{t), ra^{t) as follows. 
1 / sinvrt^ ^ 



t3 



(84) 



1 / sinvrt^ ^ 



m^{t) = M^{t) - YZrpiJ ( ) , -oo < t < oo. (85) 



Lemma 5 There exists loq > such that for any uj > ujq, M^{t) is a majorant for E^{t) of type Att 
and M^(t)dt < oo, moreover, m^j{t) is a minorant for E^{t) of type An and m^{t)dt > 0. 

Proof: First, consider t < 0. We have 

/ Riv + uj)e^''dv= / R{u)e^^''~^Uu (86) 

Jo Joj 

= e-'^*/ -aV^^e-^^du. (87) 
From the monotone convergence theorem and integration by parts 



/•CO °° f 

/ R{v + uj)e'''dv = V e""'^ <^ 



6 6uj 3a;^ lo^ 

+ 



n=0 

Then, we have from 



(t-n)4 {t-nf {t-nf t-n 



oo 

tv 



RUv)e'''dv = QUt), t<0. 







From Lemmas [H [3l for any uj > ujq 

1 



hence from 



and by ([83|) we have 



< RUv) < ^Se-y ^ - °' ^^^^ 



6 1 

0<Q^(t) < t<0, (90) 



1 / sinvrt^ ^ 



0<Af^(t)<^--^^— , t<0. (91) 
Next, consider t > 0, t ^ Z. Let us calculate — Ri^{v)e^^dv. We have 

r i?(?; + cj)e*''dt; = e""^* | T + Tj R{u)e*''du. (92) 
From the monotone convergence theorem and integration by parts 

y BMe'V„ = j: (93) 



n=l ^ ' 

and 

;3 3a;2 6a; 

,„ ^ 1 ^ _ n ~ - T7,^2 + 7^ 

n=0 ^ ' n=0 

We obtain a formula 



t-n (t - n)2 (t - nf [t - n)^ 



by the same argument as in Ahlfors [Ij, p. 188. From 

rO 

RUv)e^''dv = Q^it)-6e 

o 

Hence, from Lemmas [H HI for uj > ujq 



vr 



sinvrt 



and from Lemma [2] 



< Qu;it)-6e 



-Ldt 



vr 



sin nt 



4 ^ R"'{lo) 



1 - e- 



sin Trt\ 



irt 



I , t>0, 



(95) 



(96) 



(97) 



By continuity, (j97|) holds for all t > 0. 

For t = 0, Ei^{0) = M^{0) = 1. Therefore from ([9T|) . ([97|) we see that M;^(f) is a majorant for 
ii^^(t) for uj > ujQ. 

M^{t) is of type 47r by the following reason. Consider a rectangle F^ in the complex plane 
with vertices (n + 1/2) + i, {-n - 1/2) + i, (-n - 1/2) - i, (n + 1/2) - z, n = 1,2, • • • . From 
I sinTTZp = sin^ vrt + sinh^ vry, z = t + zy, we see that | sinvrzp is bounded by a constant on r„, 
and \Qujiz)\ is also bounded by a constant on r^. Both, constcints are independent on ti. Tlius, by 
letting n ^ oo, from the maximum principle, we have for some constant C 



\MUz)\<C, for \y\ < 1. 
Next, since |(5a;(-2)| is bounded in \y\ > 1, we have 

\M^{z)\ < C[sin7rz|^, for \y\ > 1. 
By the formula sinnz = (e*'^^ — e~^'^^)/2i, we have 

Isinvrzl^ < e^^'^', z G C. 

Prom ([98ll . (|99]) . (fT00]) . we have 

\MUz)\ < Ce^^l^l, zeC, 

which implies M^{t) is of type Att. 

f^oo ^Lo{t)dt < oo is trivial from ([U7j) . but we calculate the integral. Note that 



(98) 



(99) 



(100) 



(101) 



R{uj) 



n=0 



t — n 



sin vrt 



vr 



(it = -u^ 



n=0 



ne 



t{t — n) \ vr 



sin vrt 



dt. (102) 



Is is easy to check the following inequalities; 



\t{t - n)\ > 



{t — n)^, t > n, 
t^, t < 0, 



and 



1 



\t{t-n)\ V vr 



\ 4 -9 

sm vrt \ sm vrt 



vr' 



sin vrt 
vrt 



sinvr(t — n) 
vr(t — n) 



< 



t e M. 



vr' 



Hence, we have 



t{t - n) 



j sin nt 
V vr 





f sin nt 








/ sin irt 




\ 71" 



dt+ I -^dt + 



n 

at H — ^, 



1 / sinvrt 



„ {t-nY\ vr 



dt 



From the dominating convergence theorem, we can calculate ()102p as follows (by considering 
Cauchy's principal value) 



R{uj) 



n=0 



UJ 



n=0 



\ -e""^ 



t — n 



1 / sinvrt 



sin vrt 



TT 



dt 



dt 



1 / sinvrt 



t — n \ vr 



(it 



0. 



Therefore, we have 



M^{t)dt = T^X^e- 



n=0 



sin vrt \ ^ 6 , 1 

Tjdt + - > e 



vr 



n=0 



sinvrA'* 3lij^ 



vr J {t — n)' 



vr 



sinvrA^ R'{tjj) 



1 



1 - e- 

< CXD. 



sinvrt 
vrt 



dt + 



1 



6vr2 1 1 — e 



°° sin^vrt 



dt 



Next, we prove for m^jit). From ([85]) . ([97|) . for lj > 

4 



1 



1 - e- 



and from (pT]) . 



1 



sin vrt 
vrt 



sin vrt 



< m<^(t) < e"""*, t > 



(103) 
(104) 

^dt 

(105) 

(106) 
(107) 

(108) 



1 - e-"^ V 

so, m^{t) is a minorant for E^{t) and is of type 4vr. Since 

1 



< rn^it) < 0, t < 



(109) 



m^{t)dt= I M^{t)dt 



1 / 3a;2 
67r2 1 1 - e- 



1 - e- 



i?'(cj) 



sin vrt 
vrt 



dt 



°° sin^vrt 



(vrt)^ 



dt, 



from Lemma [2] for > 



muj{t)dt > 0. 



(110) 



5.2 Extension of Graham- Vaaler's Theorem 

Substituting t ^ -t into E^{t) defined by ([HI), we have 

EU-—t) = E^,{t). (Ill) 
to 

Define A = 2tt/uj and 

Mx,ao{t) = M^{-^t), tern, uj>o, (112) 

mx,ao{t) = mU-—t), teR, uj>0, (113) 

then both Ma_o-o(0 "1a,cto(0 of type — 2o"oA. From Lemma [5l for sufficiently small A > 0, 
Mx,aoit) and i^x,ao{t) arc majorant and minorant for E^^it), respectively. 
Based on Lemma [5l we can calculate 

loo ^ -^M^) L - ^ { - ^ I 



(114) 

< oo, (115) 

= -^,{tt;p,- y_ — * (lis) 

> 0. (117) 



We have the following theorem. The proof is an extension of the proof of Graham- Vaaler's 
Tauberian theorem to the case that the pole is of order 2. 



Theorem 5 Let X be a non-negative random variable and (p{s) be the Laplace- Stieltjes transform 
of the probability distribution function F{x) of X. The abscissa of convergence of ip{s) is denoted 
by o"o and — oo < aQ < is assumed. Let s = ao be a pole of (/?(s) of order 2 and (p{s) be analytic 
on the interval {s = cjo + I 2o"oA < r < — 2o"oA} for some A > except s = a^. Write A2 as the 
coefficient of (s — cto)^^ in the Laurent expansion of ip(s) at s = uq. Then, we have 

/oo 
mx anit)dt < liminf x-ie"'"o^P(X > x) 
-00 ' 

< limsupx-^e-''o^P(X > x) 

X—fOO 

/oo 
Mx,aoit)dt. 
-00 

Proof: For the evaluation of P(X > x) = dF{t), we first evaluate the following integral. For 
o" > (To, we have 

/•oo fOC 

e-<^ox / e-^''-''°^^dF{t) = / e'^«(*-^)e~'"*dF(t) 

J X J X 

POO 

= / E„^{t-x)e-''^dF{t) (118) 
Jo 

/oo 
Mx,^,{t-x)e-^'dF{t^, 



if F{t) is continuous at x. If x is a point of discontinuity of F{t), then the integral in (|118p does 
not exist. Since F{t) is right continuous, the set of points of discontinuity is at most countable. 
We see that the integral Mx^^oi'^ ~ x)e~^*dF{t) is continuous with respect to x E M because 
^x,(j(,{t) is bounded. e~^"~'^^^^dF{t) is monotonic decreasing in x. That is, a decreasing function 
e"('^"°'o)*dF(t) is bounded above by a continuous function e"°^ Mx^„^^{t—x)e~'^^dF{t) outside 
a countable set of x, hence, so is for all x G M. Therefore, 

poo poo 

/ e-('"-'^«)*(iF(t) < / Mx,a^{t - x)e-''^dF{t) (119) 

Jx Jo 

holds for all X € M. 

Since Ma,o-o is of type — 2(ToA, Paley- Wiener's theorem [15] shows that the support of its Fourier 
transform M\^ao is contained in the interval [2aoX, —2aoX]. Writing A = —2aoX, we have by the 
inverse Fourier transform 

Mx,aoit) = ^ p^Mx,a,{r)e''^dT, (120) 
and by substituting t — > t — x, r — > — r, 

Mx,a, {t-x) = ^ Mx,a, (-T)e-^(*-^)^dT. (121) 

Then we have by Fubini's theorem 

-I pc*o -t pA poo 

- Mx,.,it-x)e--'dF{t) = — Mx,aoi-r)e''^dT e-('^+^^)*dF(t) (122) 
X Jo 27rx 7_A Jo 

r 

27rx 

Since s = o"o is supposed to be a pole of order 2, the principal part (pois) of (p{s) at s = uo is given 
as 

Ms) = t^^,A,^0. (124) 
The inverse Laplace transform of (fois) is 

2 

^^jt-^-^e'^o*, t > 0, (125) 

then, in a similar way as ()123p . we have 

- I M,„(t - .)e-^'g^,tJ-e'.-dt = — M,„(-r) g ^ ^y ^ir. (126) 

We write ^(s) = (/^(s) — ^Pq{s), then ^(s) is analytic in a neighborhood of s = do. By subtracting 
(fT26l) from (fT23]l . 

- / MA,.o(t - x)e-^'dF{t) = V ^ / MA,.o(t - x)t^-ie-('^-°)*dt 
xJo ^ ^ -^0 

+ ^ r Mx,ao (-T)e(^ + ir)e^^"dr. (127) 



j ^Mx,aoi-rM^ + iT)e'^^dT. (123) 



Then from (fTTni) . (fTTTD we have 

+ 1^ t ^^A..o + iT)e^--dr. (128) 



By taking u; > sufficiently large, or equivalently, taking A > sufficiently small, ^(cr + it) — > 
■^(cTo+ir) as fj 1 (To uniformly in r G [—A, A] with A = — 2(ToA. Hence by the dominating convergence 
theorem, we have 

1 A ■ f°° 1 

-e~^^^PiX > x) < V ^ / Mx,.,it - xW-Ut + — / M^^^^[-r)i[ao + iT)e'^^dT. (129) 

X X Jq ZTTX J_/^ 



When X tends to infinity, the first term of the right hand side of (|129|) becomes 



limV^/ Mx,,,{t-x)p-'dt = A2 Mx,ao{t)dt, (130) 

while the second term tends to by the Riemann-Lebesgue theorem. Hence from (I129p we have 
limsup-e"''«'^P(X > x) < A2 / Mx,ao{t)dt < 00. 

x— >oo X J -00 

In a similar way, we have for minorant m^^{t) 

1 /"^ 
liminf-e-''«^P(X > x) > A2 / mxao{t)dt > 0. 

Proof of Theorem [3} From Theorem O writing Ci = mx,ao{t)dt > 0, 

C2 = A2 M\^fj^{t)dt > 0, we see that for any e > there exists xq with 

Ci - e < x-ie-'""^P(X > x) < C2 + e, Vx > xq. (131) 

By taking logarithm of each side of ()13ip . we have 

lim - log P{X > x) = ao. (132) 

X-*QO X 



We immediately obtain the following corollary of Theorem [3l 



Corollary 1 Let X be a random variable taking non-negative integral values, and 
f{z) = ^^=qP{X = n)z'^ the probability generating function of X. The radius of convergence of 
f{z) is denoted by r and 1 < r < 00 is assumed. If z = r is a pole of f{z), then the tail probability 
P{X > n) decays exponentially. 



6 Lemmas and Theorems for a Pole of Arbitrary Order 



In the last section, we proved lemmas and theorems for a pole of order 2. We here provide the 
statement of lemmas and theorems for a pole of arbitrary order, corresponding to each lemma and 
theorem in the last section. 

Let D be the order of the pole s = o"o of the Laplace-Stieltjes transform ip{s). First, define 

K=\'^\, ^l^'^^*^' (133) 
[ iJ + 1, if iJ IS even, 

so, K is always odd. Then, define 

R{v) = r^^^, veR, (134) 

r{v) =v^, V £ M, (135) 

R^(v) = R{v + uj) - -^v^, oj > 0, V eR, (136) 

k=0 

where R^^^ denotes the A:-th derivative of R. 

We show below Lemmas [If -[5f and Theorem [5f corresponding to Lemmas [T]l5] and Theorem [5] 
in the last section, respectively. 

Lemma 1* There exists ujq > such that for any uj > ujq, 

j RUv) > 0, v>0, 
1 RJv) < 0, ^; < 0. 



(137) 



Lemma 2* For sufficiently large v > 0, 



R^''Hv)<^-^, k = l,3,---,K. (138) 
1 — e ^ 



Lemma 3* There exists ujq > such that for any uj > loq, 



Rujiv) < r-^—v^, v>0. (139) 
1 — e 



Lemma 4* There exists > such that for any u > ujq, 

tK+l 



R^{v)e'''dv < t > 0. (140) 



Define two functions M^^^t) and m^{t) as follows. 

M^(t) = ;^(^^j Q^(t), -oo < t < oo, (141) 

n (f^ V -n^Y^ i-^)'r^'-'\-^) , f (-i)^-^i?(^-^(^) 

Qc.(0 = 2^e 2^ _ + , (142) 

n=0 k=l ^ ' k=l 

, , / N 1 / sin vrt \ * ^""^ , . 

m^{t) = MUt) - —— , -oo < t < cx). 143 

1 — e V nt I 



Lemma 5* There exists ujq > such that for any llj > ujq, M^{t) is a majorant for E^(t) of type 
(K + 1)-K and M^(t)dt < oo, moreover, m^^{t) is a minorant for E^{t) of type {K + l)7r and 
!Zo^Ut)dt > 0. 

Let A = 27r /uj and define 

Mx,^,{t) = MU-—t),teR, (144) 
mx^,,it) = mU-—t),teR. (145) 

Both Mx^o-oit) and mA,o-o(t) are of type —2aoX. By Lemma [5f, there exists Aq > such that for 
any A < Aq, Mx^aoi^) is a majorant and mx^ao{i) is a minorant for Eaoit), respectively. 
We can calculate Mx^a-git^dt and J_^f^\,ao{,i)dt as follows. 



Mx,ao{t)dt 



sint 



K+l 




r-OO gin^+l^ 



/ K^,,^. R^'-'H^)} -^^^^dt, (146) 

Klao ^ I 1 _ e— ^ M 7-00 ' V 7 

A;=2,fc:evon j ^ 

< OO, (147) 

fc=2, fcieven J 

> 0. (149) 

Theorem [5f Let X be a non-negative random variable and (p{s) be the Laplace- Stieltjes transform 
of the probability distribution function F{x) of X. The abscissa of convergence of ip{s) is denoted 
by ctq and —oo < aQ < is assumed. Let s = ao be a pole of ip{s) of order D and (p{s) be analytic 
on the interval {s = + ir \ 2aoX < r < —2aoX} for some A > except s = aQ. Write Ad as the 
coefficient of (s — ctq)^^ in the Laurent expansion of ip{s) at s = ctq. Then, we have 

/oo 
mxaoit)dt < liminfx"^+^e-'"o^P(X > x) 
-oo ' 

< limsupx-^+^e~''"^'P(X > x) 

X— >oo 

/oo 
Mx,ao{t)dt. 
'OO 

7 Conclusion 

We investigated a sufficient condition for the exponential decay of the tail probability P{X > x) 
of a non-negative random variable X. For the Laplace-Stieltjes transform (p{s) of the probability 
distribution function of X with abscissa of convergence ctq, — oo < do < 0, we showed that if 
s = o"o is a pole of ip{s) then the tail probability decays exponentially. If (p{s) is given explicitly, 
then this sufficient condition is easy to check. For the proof of our main theorem, we extended 
Graham- Vaaler's Tauberian theorem to the case that the order of the pole of (p{s) is arbitrary. 
Now, I have proved the conjecture that was written in [llj . 
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